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METHOD AND UNIT FOR PROCESSING IMAGE_SIGNAL.ANP 

IMAGE DI SPLAY DEVI CE^ 

TECHNICAL FIELD 

The present invention relates to an image signal processing 
method and unit for performing nonlinear compensation on image 
signals, and to an image display device using the method and unit. 



BACKGROUND ART 

Human visual characteristics are nonlinear. In particular, the 
degree of brightness human beings feel has characteristics of a 
logarithmic function with respect to luminance, as shown in Fig. 5. 

15 In a cathode ray tube (CRT), the display luminance with respect to an 
image signal has so-called gamma characteristics, as shown in Fig. 6A. 
Thus, in a display device using CRTs, the gamma characteristics and 
visual characteristics of a logarithmic function cancel out each other 
and the degree of brightness human beings feel has characteristics 

20 substantially linear with respect to image signals. 

In contrast, newly-developed display devices, such as a digital 
mirror device (DMD) and plasma display panel (PDP), do not have the 
gamma characteristics. As shown in Fig. 6B, these display devices 
have characteristics in which the display luminance is linear with 

25 respect to image signals. Therefore, in these display devices, the 
degree of brightness human beings feel exhibits characteristics of a 
logarithmic function with respect to image signals. For this reason, 
to compensate the degree of brightness of image signals human beings 
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feel to have linear characteristics, nonlinear compensation must be 
performed on the image signals. Proposed as one of the methods is 
using a look-up table (hereinafter abbreviated as "LUT") to perform 
nonlinear compensation, as shown in Fig. 7 (see Japanese Patent 
5 Unexamined Publication H10- 153983, for example). 

Fig. 8 is a table showing an example of input-output 
characteristics in such a LUT. In this table, "input gradation" is an 
image signal before compensation, and the signal levels of the image 
signals to be fed into the LUT are expressed in 256 steps, i.e. "0" to 
10 "255". "Display gradation" is an image signal after compensation, 
and the signal levels supplied from the LUT are standardized so that 
the maximum value thereof is "255". In Fig. 8, the display gradations 
are shown only when the input gradations are "0", "10", "20", and so on, 
to "250". 

15 When a display device is installed in a dark place, and no 

ambient light incident on the display device, nonlinear compensation 
is performed on the input gradations to be fed into a display device 
having no gamma characteristics, such as a PDP, as shown in Fig. 8. 
Then, the relation between the input gradation and display luminance 

20 exhibits gamma characteristics, as shown by characteristic curve A in 
Fig. 9A. Thus, the degree of brightness human beings feel and input 
gradations are substantially linear, as shown by characteristics curve 
B in Fig. 9B. 

However, when the display device is installed in a bright place, 
25 the display luminance is uniformly increased by the influence of 
ambient light, as shown by characteristic curve C in Fig. 9A. Thus, 
even the conventional nonlinear compensation cannot return the 
degree of brightness human beings feel so as to have linear 
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characteristics. Characteristic curve D in Fig. 9B shows the degree of 
brightness human beings feel with respect to the input gradations at 
that time. Human beings cannot recognize a change in gradation 
clearly in the portion of low input gradations. 
5 This phenomenon depends on the human visual characteristics 

and can be considered as follows. Assume that the display gradations 
shown in Fig. 8 indicate the display luminance in a dark place. Then, 
when the input gradation increases from 10 gradations to 20 
gradations, the display luminance increases "0.2" to "0.9", thus making 

10 human beings feel that the brightness is 4.5 times. In contrast, 
assume the display luminance increases by a luminance corresponding 
to "30", for example, in a bright place, under the influence of ambient 
light incident to the display device. In this case, even when the input 
gradation increases from 10 gradations to 20 gradations, the display 

15 luminance increases from "30.2" to "30.9" only. Thus, human beings 
almost cannot feel a change in brightness. Of course, for a brighter 
image, the ratio of the display luminance between 240 gradations and 
250 gradations in a dark place, for example, is 244.1/223.2 = 1.09. 
The ratio between the same gradations in a bright place is 274.1/253.2 

20 = 1.08. These figures do not have a large difference and thus the 
influence of ambient light is negligible. 

As described above, for the conventional method of nonlinear 
compensation, because a display device is influenced by the ambient 
light incident thereon, the degree of brightness human beings feel 

25 cannot be compensated to have linear characteristics. Particularly in 
a dark image having low input gradations, a change in gradation 
cannot be recognized and the gradations become uniform. 

The present invention addresses this problem and aims to 



#- 



provide an image signal processing method and unit capable of 
compensating the characteristics of brightness of image signals human 
beings feel, even when the display luminance of a display device has 
characteristics linear with respect to the image signals and the display 
5 luminance is uniformly increased by the influence of ambient light 
incident to the display device. The present invention also aims to 
provide an image display using the method and unit. 

SUMMARY OF THE INVENTION 

10 The present invention provides an image signal processing 

method for performing nonlinear compensation on image signals to be 
fed into a display device. According to the brightness of the place in 
which the display device is installed, the characteristics of nonlinear 
compensation are changed. 

15 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a circuit block diagram of an image display device in 
accordance with a first exemplary embodiment of the present 
invention. 

20 Fig. 2A is a graph showing a relation between an input 

gradation and display luminance in an image signal compensation 
method in accordance with the first exemplary embodiment. 

Fig. 2B is a graph showing a relation between an input 
gradation and a degree of brightness human beings feel. 
25 Fig. 3 is a circuit block diagram of another image display device 

in accordance with the first exemplary embodiment. 

Fig. 4 is a circuit block diagram of an image display device in 
accordance with a second exemplary embodiment. 
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Fig. 5 is a graph showing a degree of brightness human beings 
feel with respect to luminance. 

Fig. 6A is a graph showing a relation between an image signal 
and display luminance in a cathode ray tube (CRT). 

Fig. 6B is a graph showing a relation between an image signal 
and display luminance in a digital mirror device (DMD) and plasma 
display panel (PDP). 

Fig. 7 is a circuit block diagram of a conventional image display 
device. 

Fig. 8 is a table showing an example of input-output 
characteristics in a look up table. 

Fig. 9A is a graph showing a relation between an input 
gradation and display luminance in a conventional image signal 
compensation method. 

Fig. 9B is a graph showing a relation between an input 
gradation and a degree of brightness human beings feel. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

Exemplary embodiments of the present invention are 
20 hereinafter demonstrated with reference to the accompanying 
drawings. 

FIRST EXEMPLARY EMBODIMNT 

Fig. 1 is a circuit block diagram of image display device 100 in 
25 accordance with the first exemplary embodiment of the present 
invention. Image signal processing unit 101 performs nonlinear 
compensation on an input image signal, i.e. input gradation, and 
outputs a signal to display device 103. Display device 103 is a display 
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device having no gamma characteristics, such as a digital mirror 
device (DMD) and plasma display panel (PDP). Image signal 
processing unit 101 includes ambient light detector 104 for detecting 
the brightness of ambient light, and compensator 105 for performing 
5 nonlinear compensation on the input gradation according to the 
brightness of the ambient light. 

Ambient light detector 104 includes optical sensor 106 for 
sensing the brightness of ambient light, and analog-to-digital (A/D) 
converter 107 for converting a signal sensed by optical sensor 106 to a 

10 digital signal. Compensator 105 includes a plurality of look-up tables 
(LUTs) 108i to IO84 used for nonlinear compensation on the input 
gradation, and LUT selector 112 for selecting one LUT from among the 
plurality of LUTs IO81 to IO84, according to the signal detected by 
ambient light detector 104. Fig. 1 illustrates four LUTs IO81 to 108 4 ; 

15 however, of course, the number of LUTs is not limited to four. An 
arbitrary number of LUTs can be used as required. Generally, an 
increased number of LUTs can accommodate a wider range of ambient 
light and set a change in display luminance caused by switching the 
LUTs smaller. 

20 Each of the plurality of LUTs IO81 to IO84 performs nonlinear 

compensation on the input gradation according to the following 
equation: 

(Display gradation) = K x (input gradation) 7 

Now, gamma factor y is a value larger than 1, which is set to a 
25 different value for each of the LUTs. Coefficient K is a coefficient for 
making the maximum value of the display gradation equal to the 
maximum value of the input gradation, and is expressed by the 
following equation^ 
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K = (maximum value of input gradation) (1 " Y) 

In this embodiment, LUT 108i is a LUT for nonlinear 
compensation in a dark place without ambient light. In this LUT, 
gamma factor y is set to 2.2. When nonlinear compensation is 
5 performed on an input gradation using LUT IO81 in a dark place for 
image display, the relation between the input gradation and display 
luminance is as shown by characteristic curve A in Fig. 2A. The 
degree of brightness human beings feel exhibits characteristics 
substantially linear with respect to an input gradation, as shown in 

10 characteristic curve B in Fig. 2B. When nonlinear compensation is 
performed on an input gradation using LUT IO81 for a dark place with 
the display luminance uniformly increased by the influence of ambient 
light as shown by characteristic curve C in Fig. 2A, the linearity of the 
brightness human beings feel is affected, as shown by characteristic 

15 curve D in Fig. 2B, and gradations become uniform in the part of low 
input gradations. Therefore, in this case, nonlinear compensation is 
performed using LUT IO84 having a small gamma factor y, as shown by 
characteristic curve E in Fig. 2A. Then, the degree of brightness 
human beings feel can be compensated so as to substantially be linear 

20 with respect to an input gradation, as shown by characteristic curve F 
in Fig. 2B. 

In this embodiment, gamma factors y of four LUTs IO81 to IO84 
are set to 2.2, 2.1, 2.0, and 1.9, respectively. Based on the detection 
results of ambient light detector 104, these LUTs are switched. 
25 However, if the characteristics of nonlinear compensation performed 
on an input gradation can be changed according to ambient light, 
another structure can also be used. For example, the function of the 
plurality of look-up tables and look-up table selector can be achieved 
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by using a processor, such as a digital signal processor. An image 
signal processing unit can also be structured by using processor 200 as 
compensator 205 to input an image signal and detected signal of 
ambient light and output a display gradation. This structure can 
form a compensator with a smaller number of circuit components. 

In this embodiment, the characteristics of nonlinear 
compensation are changed by changing the value of gamma factor y- 
However, the characteristics of nonlinear compensation can be 
changed by other methods. For example, the characteristics of 
nonlinear compensation can be obtained by measuring the 
compensation characteristics such that the brightness human beings 
feel under influence of various kinds of ambient light is linear with 
respect to an image signal before compensation. Thus, even in a 
display device of which display luminance has any characteristics with 
respect to an image signal, the compensation characteristics such that 
the brightness human beings feel is linear with respect to an image 
signal before compensation can be obtained. 

SECOND EXEMPLARY EMBODIMENT 

20 Fig. 4 is a circuit block diagram of image display device 300 in 

accordance with the second exemplary embodiment of the present 
invention. The same elements of the circuit block of the first 
exemplary embodiment are denoted with the same reference marks, 
and descriptions thereof are omitted. The second exemplary 

25 embodiment differs from the first exemplary embodiment in that the 
characteristics of nonlinear compensation are changed not only 
according to ambient light but also to the display modes of display 
device 103. For example, in a display device using a PDP, the number 
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of gradations it can display (hereinafter referred to as "gradation 
display capability") conflicts with the maximum luminance it can 
display, because of its driving principle. Then, as the display modes 
of display device 103, dynamic mode", "standard mode", "cinema mode", 
5 and the like are provided, so that a user can select a desired display 
mode. Now, in "dynamic mode", the gradation display capability is 
substantially given up to increase the maximum luminance. In 
"cinema mode", the maximum luminance is inhibited to increase the 
gradation display capability. "Standard mode" is an intermediate 

10 display mode between them. 

As described above, the brightness human beings feel is 
influenced by ambient light. However, of course, the brightness is 
influenced directly by the luminance of a display device. For this 
reason, to make the brightness human beings feel linear with respect 

15 to an input gradation, the characteristics of nonlinear compensation 
should be changed not only according to ambient light but also to the 
maximum luminance a display device displays. 

Compensator 305 includes a plurality of LUTs 108i to IO812 
used for performing nonlinear compensation on an input gradation, 

20 and LUT selector 312 for selecting one LUT from among the plurality 
of LUTs IO81 to IO812 according to a signal detected by ambient light 
detector 104 and a display mode signal supplied from display device 
103. Fig. 4 illustrates a structure having four LUTs for each display 
mode, 12 LUTs in total. Of course, an arbitrary number of LUTs can 

25 be provided as required. 

In the same display mode, as ambient light increase, the LUT is 
switched to one having a smaller gamma factor y- When the ambient 
light is the same, a LUT having a larger gamma factor y is used in 
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"dynamic mode". In "cinema mode", a LUT having a smaller gamma 
factor y is used. 

By changing the characteristics of nonlinear compensation 
depending on not only ambient light but also on the display modes of a 
5 display device as described above, the brightness human beings feel 
can be compensated so as to substantially be linear with respect to an 
input gradation, even when a user switches the display mode to 
change the maximum luminance of the display device. 

In the second exemplary embodiment, as a signal indicating the 

10 maximum luminance display device 103 displays, a display mode 
signal supplied from the display device is used. However, any other 
signal that indicates the maximum luminance the display device 
displays can be used. For example, the average picture level (APL) of 
an image signal before compensation can be used. Additionally, as 

15 signals indicating the maximum luminance of the display device, both 
of a signal indicating the display mode and the APL of an image signal 
can be used. 

Also in the second exemplary embodiment, a plurality of LUTs 
is switched as compensator 305. However, any another structure for 

20 changing the characteristics of nonlinear compensation can be used. 
For example, compensator 305 can be structured by using a processor, 
such as a digital signal processor, to input an image signal, a detected 
signal of ambient light, and a signal indicating the maximum 
luminance and output a display gradation. 

25 Also in the second exemplary embodiment, the characteristics of 

nonlinear compensation are changed by switching a plurality of LUTs, 
each having a different gamma factor y- However, the characteristics 
of nonlinear compensation can be obtained by measuring the 
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compensation characteristics such that the brightness human beings 
feel under influence of various kinds of ambient light and the 
maximum luminance of the display device is linear with respect to an 
input gradation. 

The present invention can provide a method and unit for 
processing an image signal that can make the characteristics of 
brightness human beings feel linear with respect to an image signal, 
even when the display luminance of the display device is uniformly 
increased by the influence of ambient light. The present invention 
can also provide an image display device using the method and unit. 

INDUSTRIAL APPLICABILITY 

A method and unit for processing an image signal, and an image 
display device of the present invention can make the characteristics of 
brightness of human beings feel linear with respect to an image signal, 
even when the display luminance of the display device is uniformly 
increased by the influence of ambient light. Thus, the present 
invention is useful as an image display device or the like for 
performing nonlinear compensation on image signals. 



